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DETAILED ACTION 
Response to Arguments 

1 . Applicant's arguments filed 14 July 2008 have been fully considered but 
they are not persuasive. Applicant argues that the claims do not require nor use 
white balance amplifiers or controllers and are therefore patentably distinct from 
Hashimoto in view of Ogawa in view of Roberts. However the claims as written 
use "comprising" language, therefore the claims as written do not explicitly 
require that white balance controllers not be used, see MPEP §21 1 1 .03. It is 
further noted that the claimed "analog compensation unit[s]" are readable on the 
white balance amplifiers used by Hashimoto (i.e. the white balance amplifiers of 
Hashimoto are coupled to at least one element associated with a color filter 
component and modify a readout of the at least one element associated with the 
color component). Therefore, while the claims as written do not include the 
terms "white balance amplifier" or "white balance controller", the claims do not 
exclude the use of such components. 

2. In response to applicant's argument that the references fail to show certain 
features of applicant's invention, it is noted that the features upon which applicant 
relies (i.e., analog color amplification summation and compensation without the 
use of white balance amplifiers or controllers) are not recited in the rejected 
claim(s). Although the claims are interpreted in light of the specification, 
limitations from the specification are not read into the claims. See In re Van 
Geuns, 988 F.2d 1181, 26 USPQ2d 1057 (Fed. Cir. 1993). Therefore, Applicants 
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arguments are not considered persuasive and do not place the application in 
condition for allowance. 



Claim Rejections - 35 USC § 103 

3. The text of those sections of Title 35, U.S. Code not included in this action 
can be found in a prior Office action. 

4. Claims 1,3,4,6,1 2-22, 26, 28, 29, 31 , 33, 35, 36, 39 and 40 are rejected 
under 35 U.S.C. 103(a) as being unpatentable over Hashimoto (US 4,768,085) in 
view of Ogawa et al. (US 7,142,233) in view of Roberts (5,541,654). 

[claim 1] 

In regard to claim 1 , note that Hashimoto discloses a color imaging system 
for compensating a color response comprising: an array of pixel sensor elements 
(e.g. Figure 1 ); a color filter including a plurality of color filter components 
organized in a predefined pattern, the color filter overlaying at least a portion of 
the array, wherein the pixel sensor elements include at least one element 
associated with a first color filter component, at least one element associated 
with a second color component and at least one element associated with a third 
color component (e.g. Figure 1 ; c. 3, II. 37-47); a first and second analog 
compensation unit coupled to at least one element associated with the first and 
second color filter components, respectively, the analog compensation units 
adapted to modify a readout of at least one element associated with the 
respective color component (Figure 5, Items 4 and 5; c. 4, II. 55-59); an analog 
summer (i.e. summing amplifier) coupled to two elements associated with the 
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third color filter component and outputting an analog sum of the two elements 
(Figure 2, Item 2a3; Figure 5); a third analog compensation unit coupled to at 
least one element associated with the first and second color filter components, 
respectively, the analog compensation units adapted to modify a readout of at 
least one element associated with the respective color component (Figure 5, Item 
3; c. 4, II. 55-59); and an array controller (Figure 1 , Items 2a1 , 2a2). Hashimoto 
further discloses simultaneous readout of two horizontal lines, but does not 
explicitly disclose simultaneous readout of a 2x2 block. 

Ogawa discloses an image sensor which reads out pixel signals in units of 
blocks (i.e. simultaneous readout of a 2x2 block; Figure 4; c. 3, II. 57-59). Ogawa 
further discloses that this manner of readout the basic blocks necessary for 
interpolation processing are available and an interpolated signal for an arbitrarily 
read region can be obtained at random (c. 7, II. 39-50). Therefore, it would have 
been obvious to one of ordinary skill in the art at the time the invention was made 
to perform readout in units of blocks as taught by Ogawa in the image sensor of 
Hashimoto in order to allow for interpolated signals of arbitrary regions to be 
obtained at random. It is further noted that the filter pattern of Hashimoto is not a 
Bayer pattern (Figure 1 , note that the g1 and g2 pixels are not offset diagonally). 
While Ogawa discloses an embodiment which uses a Bayer pattern, Ogawa is 
not limited in any way to this arrangement (c. 7, II. 55-60). For example, it is 
noted that Ogawa discloses a second embodiment which does not use a Bayer 
pattern (Figures 7-10). However, Hashimoto in view of Ogawa lacks readout of 
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components in a selected window of the array while other sections of the array 
are not processed. 

Roberts teaches the use of a windowing operation in which a subset of the 
array (Figure 6, Items 172 or 174) are readout independently from the rest of the 
array. Roberts further discloses that the rest of the array may not be read out 
(i.e. processed) while the window may be scanned at a frame rate much higher 
than if the entire array were to be read out (c. 10, II. 9-21). Therefore, it would 
have been obvious to one of ordinary skill in the art at the time the invention was 
made to implement a windowing operation in the device of Hashimoto in order to 
achieve higher frame rates by reading out (i.e. processing) only a subset of the 
entire array. The examiner notes that Roberts discloses the use of a control 
circuit 32 and decoding and latching circuits 22 and 24 (c. 4, II. 20-41). 
[claim 3] 

In regard to claim 3, note that Hashimoto discloses an array which is 
arranged in a plurality of rows and columns (e.g. Figure 1). 
[claim 4] 

In regard to claim 4, note that Hashimoto discloses an array controller 
adapted to control readout of a plurality of pixel sensor elements in parallel (c.4, 
II. 5-15). 
[claim 6] 

In regard to claim 6, note that Hashimoto discloses analog compensation 
units which are gain amplifiers (c.4, II. 55-59). 
[claim 12] 
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In regard to claim 12, note that Hashimoto discloses color filter 
components including the colors of red, blue and green (Figure 1 ; c. 3, II. 37-47). 
[claims 13 and 14] 

In regard to claims 13 and 14, Hashimoto discloses all limitations except 
for the interlaced or odd and even readout modes of columns and rows. 
However, the use of independent readout of even and odd rows or columns is 
well known in the art to create industry standard NTSC TV signals or to reduce 
the amount of data readout during for a frame when a high frame rate is more 
important than high resolution. Therefore, It would have been obvious to one of 
ordinary skill in the art at the time the invention was made to use even and odd 
row or column readout with the imaging system of Hashimoto to create NTSC TV 
signals or to reduce the resolution in order to achieve higher frame rates, 
[claim 15] 

In regard to claim 15, note that Ogawa discloses an array controller which 
causes a plurality of substantially simultaneous, independent readouts for a 
plurality of rows and some columns (Figure 4; c. 3, II. 57-59). 
[claims 16 and 19] 

In regard to claims 16 and 19, Hashimoto discloses all limitations except 
for a passive CCD imaging device. However, the use of CCD imagers in 
cameras is well known in the art to provide higher sensitivity than other imagers, 
such as CMOS imagers (Official Notice). Therefore, It would have been obvious 
to one of ordinary skill in the art at the time the invention was made to use a 
passive CCD imager as the imaging device of Hashimoto to achieve higher 
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sensitivity. 

[claims 17 and 18] 

In regard to claims 17 and 18, Hashimoto discloses all limitations except 
for an active CMOS imaging sensor device. However, it is well known in the art 
to use active CMOS image sensors in applications where nondestructive readout 
of pixels is required, such as in Hashimoto (e.g. c. 3, II. 48-52). Therefore, It 
would have been obvious to one of ordinary skill in the art at the time the 
invention was made to use an active CMOS image sensor in the imaging system 
of Hashimoto to allow for non-destructive readout of the image sensor (Official 
Notice), 
[claim 20] 

In regard to claim 20, note that at least a first pixel sensor element of 
Hashimoto is associated with a different color than a second, neighboring pixel 
sensor element (Figure 1 ). 
[claim 22] 

In regard to claim 22, note that Hashimoto discloses all limitations except 
for a complementary color scheme include yellow, cyan and magenta color 
filters. However, the use of yellow, cyan and magenta is a well known design 
alternative to the use of red, green and blue color filters as is well known in the 
art. Therefore, It would have been obvious to one of ordinary skill in the art at the 
time the invention was made to use yellow, cyan and magenta color filters to 
achieve color images (Official Notice), 
[claim 26] 
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In regard to claim 26, note that Hashimoto discloses a method of 
compensating color response in an analog domain of an array of pixel sensor 
elements comprising: amplifying an analog output from a plurality of elements of 
a first color component (Figure 5, Item 4; c. 4, II. 55-59); amplifying an analog 
output from a plurality of elements of a second color component wherein two said 
elements outputs are summed together prior to the amplifying (Figure 5, Item 3 
and (G1+G2); c. 4, II. 55-59; c. 5, II. 49-60); and generating a compensated 
analog readout of the plurality of elements of the first color component (Figure 5) 
, Hashimoto further discloses simultaneous readout of two horizontal lines, but 
does not explicitly disclose simultaneous readout of a 2x2 block. 

Ogawa discloses an image sensor which reads out pixel signals in units of 
blocks (i.e. simultaneous readout of a 2x2 block; Figure 4; c. 3, II. 57-59). Ogawa 
further discloses that this manner of readout the basic blocks necessary for 
interpolation processing are available and an interpolated signal for an arbitrarily 
read region can be obtained at random (c. 7, II. 39-50). Therefore, it would have 
been obvious to one of ordinary skill in the art at the time the invention was made 
to perform readout in units of blocks as taught by Ogawa in the image sensor of 
Hashimoto in order to allow for interpolated signals of arbitrary regions to be 
obtained at random. It is further noted that the filter pattern of Hashimoto is not a 
Bayer pattern (Figure 1 , note that the g1 and g2 pixels are not offset diagonally). 
While Ogawa discloses an embodiment which uses a Bayer pattern, Ogawa is 
not limited in any way to this arrangement (c. 7, II. 55-60). For example, it is 
noted that Ogawa discloses a second embodiment which does not use a Bayer 
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pattern (Figures 7-10). However, Hashimoto in view of Ogawa lacks readout of 
components in a selected window of the array while other sections of the array 
are not processed. 

Roberts teaches the use of a windowing operation in which a subset of the 
array (Figure 6, Items 172 or 174) are readout independently from the rest of the 
array. Roberts further discloses that the rest of the array may not be read out 
(i.e. processed) while the window may be scanned at a frame rate much higher 
than if the entire array were to be read out (c. 10, II. 9-21). Therefore, it would 
have been obvious to one of ordinary skill in the art at the time the invention was 
made to implement a windowing operation in the device of Hashimoto in order to 
achieve higher frame rates by reading out (i.e. processing) only a subset of the 
entire array. The examiner notes that Roberts discloses the use of a control 
circuit 32 and decoding and latching circuits 22 and 24 (c. 4, II. 20-41). 
[claim 28] 

In regard to claim 28, note that Hashimoto discloses generating a 
compensated analog readout comprising amplifying the analog readout for the 
plurality of elements of the first color component with a first programmable gain 
amplifier (i.e. white balance amplifier; c.4, II. 55-59; The office notes that the 
system of figure 5 would inherently include such a white balance controller to 
allow for proper white balance, even though such a controller is not depicted), 
[claim 29] 

In regard to claim 29, note that Hashimoto discloses white balancing the 
first color component (i.e. determining an optical level of color compensation for 
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the analog readout of the plurality of elements of the first color component; c. 4; 
II. 55-59). 
[claim 31] 

In regard to claim 31 , note that the Hashimoto discloses sensor elements 
that are associated with the colors of red, blue and green (Figure 1 ; c. 3, II. 37- 
47). 

[claim 33] 

In regard to claim 33, note that Ogawa discloses an act of generating 
comprising generating a plurality of substantially simultaneous, independent 
readouts for the set of rows and the set of columns (Figure 4; c. 3, II. 57-59). 
[claim 35] 

In regard to claim 35, note that Hashimoto discloses a color imaging 
system for compensating a color response comprising: an array of pixel sensor 
elements (e.g. Figure 1); a color filter including a plurality of color filter 
components organized in a predefined pattern, the color filter overlaying at least 
a portion of the array, wherein the pixel sensor elements include at least one 
element associated with a first color filter component, at least one element 
associated with a second color component and at least one element associated 
with a third color component (e.g. Figure 1; c. 3, II. 37-47); a first and second 
analog compensation unit coupled to at least one element associated with the 
first and second color filter components, respectively, the analog compensation 
units adapted to modify a readout of at least one element associated with the 
respective color component (Figure 5, Items 4 and 5; c. 4, II. 55-59); an analog 
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summer (i.e. summing amplifier) coupled to two elements associated with the 
third color filter component and outputting an analog sum of the two elements 
(Figure 2, Item 2a3; Figure 5); a third analog compensation unit coupled to at 
least one element associated with the first and second color filter components, 
respectively, the analog compensation units adapted to modify a readout of at 
least one element associated with the respective color component (Figure 5, Item 
3; c. 4, II. 55-59); and an array controller which selectively couples elements 
associated with the first, second and third colors to the first, second and third 
amplifiers respectively (Figure 2; Figure 5; note the individual colors connected to 
individual amplifiers). Hashimoto further discloses simultaneous readout of two 
horizontal lines, but does not explicitly disclose simultaneous readout of a 2x2 
block. 

Ogawa discloses an image sensor which reads out pixel signals in units of 
blocks (i.e. simultaneous readout of a 2x2 block; Figure 4; c. 3, II. 57-59). Ogawa 
further discloses that this manner of readout the basic blocks necessary for 
interpolation processing are available and an interpolated signal for an arbitrarily 
read region can be obtained at random (c. 7, II. 39-50). Therefore, it would have 
been obvious to one of ordinary skill in the art at the time the invention was made 
to perform readout in units of blocks as taught by Ogawa in the image sensor of 
Hashimoto in order to allow for interpolated signals of arbitrary regions to be 
obtained at random. It is further noted that the filter pattern of Hashimoto is not a 
Bayer pattern (Figure 1 , note that the g1 and g2 pixels are not offset diagonally). 
While Ogawa discloses an embodiment which uses a Bayer pattern, Ogawa is 
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not limited in any way to this arrangement (c. 7, II. 55-60). For example, it is 
noted that Ogawa discloses a second embodiment which does not use a Bayer 
pattern (Figures 7-10). However, Hashimoto in view of Ogawa lacks readout of 
components in a selected window of the array while other sections of the array 
are not processed. 

Roberts teaches the use of a windowing operation in which a subset of the 
array (Figure 6, Items 172 or 174) are readout independently from the rest of the 
array. Roberts further discloses that the rest of the array may not be read out 
(i.e. processed) while the window may be scanned at a frame rate much higher 
than if the entire array were to be read out (c. 10, II. 9-21). Therefore, it would 
have been obvious to one of ordinary skill in the art at the time the invention was 
made to implement a windowing operation in the device of Hashimoto in order to 
achieve higher frame rates by reading out (i.e. processing) only a subset of the 
entire array. The examiner notes that Roberts discloses the use of a control 
circuit 32 and decoding and latching circuits 22 and 24 (c. 4, II. 20-41). Roberts 
further discloses the use of the control circuit to perform windowing by resetting 
and reading of pixels under variable patterns (c. 7, II. 33-45). [claim 36] 

In regard to claim 36, note that Hashimoto discloses sensor elements 
arranged in rows and columns (Figure 1). 
[claim 39] 

In regard to claim 39, note that Hashimoto discloses a method of 
interpolating a color value in the analog domain in real-time, comprising: 
modifying a first analog signal corresponding to the output of a first pixel element 
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in an imager to color correct the first pixel, wherein the first pixel element is used 
to sense light intensity of a first color (e.g. Figure 5, Item 4; c. 4, II. 55-59); and 
modifying a second analog signal corresponding to the output of a second and a 
third pixel element in an imager to color correct the second and third pixels, 
wherein the second and third pixels are used to sense light intensity of a second 
color and wherein the second analog signal is a sum of the second a third pixel 
elements (Figure 5, Item 3; c. 4, II. 55-59; The office notes that the system of 
Hashimoto modifies the analog signals by white balancing them). Hashimoto 
further discloses simultaneous readout of two horizontal lines, but does not 
explicitly disclose simultaneous readout of a 2x2 block. 

Ogawa discloses an image sensor which reads out pixel signals in units of 
blocks (i.e. simultaneous readout of a 2x2 block; Figure 4; c. 3, II. 57-59). Ogawa 
further discloses that this manner of readout the basic blocks necessary for 
interpolation processing are available and an interpolated signal for an arbitrarily 
read region can be obtained at random (c. 7, II. 39-50). Therefore, it would have 
been obvious to one of ordinary skill in the art at the time the invention was made 
to perform readout in units of blocks as taught by Ogawa in the image sensor of 
Hashimoto in order to allow for interpolated signals of arbitrary regions to be 
obtained at random. It is further noted that the filter pattern of Hashimoto is not a 
Bayer pattern (Figure 1 , note that the g1 and g2 pixels are not offset diagonally). 
While Ogawa discloses an embodiment which uses a Bayer pattern, Ogawa is 
not limited in any way to this arrangement (c. 7, II. 55-60). For example, it is 
noted that Ogawa discloses a second embodiment which does not use a Bayer 
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pattern (Figures 7-10). However, Hashimoto in view of Ogawa lacks readout of 
components in a selected window of the array while other sections of the array 
are not processed. 

Roberts teaches the use of a windowing operation in which a subset of the 
array (Figure 6, Items 172 or 174) are readout independently from the rest of the 
array. Roberts further discloses that the rest of the array may not be read out 
(i.e. processed) while the window may be scanned at a frame rate much higher 
than if the entire array were to be read out (c. 10, II. 9-21). Therefore, it would 
have been obvious to one of ordinary skill in the art at the time the invention was 
made to implement a windowing operation in the device of Hashimoto in order to 
achieve higher frame rates by reading out (i.e. processing) only a subset of the 
entire array. The examiner notes that Roberts discloses the use of a control 
circuit 32 and decoding and latching circuits 22 and 24 (c. 4, II. 20-41). 
[claim 40] 

In regard to claim 40, note that Hashimoto discloses modifying a third 
analog signal corresponding to the output of a third pixel element in the imager to 
color correct the third pixel (Figure 5, Item 5; c. 4, II. 55-59) 

5. Claims 7, 8, 30 and 32 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Hashimoto (US 4,768,085) in view of Ogawa et al. (US 
7,142,233) in view of Roberts (US 5,541 ,654) as applied to claim 1 above, and in 
further view of Boisvert et al. (US 5,329,31 2). 
[claim 7] 
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In regard to claim 7, note that Hashimoto in view of Ogawa in view of 
Roberts discloses all limitations except for analog compensation units which are 
programmable gain amplifiers. Boisvert et al. teaches an improved analog signal 
processing system which provides white balancing with minimal dark level 
differences (e.g. c. 5, II. 7-29) using separate programmable gain amplifiers for 
each pixel color (e.g. Figure 1 ; Figure 2; c. 6, II. 14-45). Therefore, it would have 
been obvious to one of ordinary skill in the art at the time the invention was made 
to use the programmable gain amplifiers of Boisvert et al. in the white balance 
system of Hashimoto to reduce the amount of dark level differences between the 
colors, 
[claim 8] 

In regard to claim 8, see claim 7. 
[claim 30] 

In regard to claim 30, note that Hashimoto in view of Ogawa in view of 
Roberts discloses all limitations except for a compensated analog readout that 
depends on a temperature of the system. Boisvert et al. teaches an improved 
analog signal processing system which provides white balancing with minimal 
dark level differences (e.g. c. 5, II. 7-29) using separate programmable gain 
amplifiers for each pixel color (e.g. Figure 1; Figure 2; c. 6, II. 14-45). Therefore, 
it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to use the programmable gain amplifiers of Boisvert et al. in 
the white balance system of Hashimoto to reduce the amount of dark level 
differences between the colors. It is further noted that the analog signal 
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processors of Boisvert et al. are temperature compensated (i.e. the readout 
depends on temperature of the system; c. 13, II. 20-24). 
[claim 32] 

In regard to claim 32, note that Hashimoto in view of Ogawa discloses an 
act of generating comprising: generating an independent readout for even 
numbered rows (i.e. Figure 2, Items G2 and B2); generating an independent 
readout for odd numbered rows (i.e. Figure 2, Items G1 and R1); generating an 
independent readout for even numbered columns (i.e. Figure 2, Items R1 and 
B2); and generating an independent readout for odd numbered columns (i.e. 
Figure 1, Items G1 and G2; The office notes that each of the pixel elements G1, 
B1, G2 and R2 are readout independently (i.e. on independent readout lines) 
from each other which meets the limitation of the claims, such that at least one 
element associated with red, blue and green filter components are coupled to 
first, second and third gain amplifiers respectively (Figure 5). Therefore, it can be 
seen that Hashimoto lacks programmable gain amplifiers for each color 
component. 

Boisvert et al. teaches an improved analog signal processing system 
which provides white balancing with minimal dark level differences (e.g. c. 5, II. 7- 
29) using separate programmable gain amplifiers for each pixel color (e.g. Figure 
1 ; Figure 2; c. 6, II. 14-45). Therefore, it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to use the 
programmable gain amplifiers of Boisvert et al. in the white balance system of 
Hashimoto to reduce the amount of dark level differences between the colors. 
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6. Claim 9 and 10 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Hashimoto (US 4,768,085) in view of Ogawa et al. (US 
7,142,233) in view of Roberts (US 5,541 ,654) in view of Boisvert et al. (US 
5,329,312) as applied to claim 7 above, and in further view of Zhou et al. (IEEE), 
[claims 9 and 10] 

In regard to claims 9 and 10 it can be seen that Hashimoto in view of 
Ogawa in view of Roberts in view of Boisvert disclose all limitations except for 
programmable gain amplifiers contained within the pixel circuitry and within a 
plurality of column buffers. However, such a system is well known in the art, (for 
example see Zhou, Figures 1 and 2) as a way to reduce the overall size of 
imaging systems. Therefore, It would have been obvious to one of ordinary skill 
in the art at the time the invention was made to alter the design of Boisvert with 
the gain amplifiers of Zhou contained in the pixel circuitry of the array in a 
plurality of column buffers to reduce the overall size. 

7. Claim 23 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Hashimoto (US 4,768,085) in view of Ogawa et al. (US 7,142,233) in view of 
Roberts (US 5,541 ,654) as applied to claim 1 above, and in further Sano et al. 
(IEEE). 

[claim 23] 

In regard to claim 23, note that Hashimoto in view of Ogawa in view of 
Roberts discloses all limitations except for a micro-lens layer. However, the use 
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of micro-lens layers on image sensors is well known in the art to increase 
photosensitivity of the image sensor arrays, for example see Sano et al. (IEEE). 
Therefore, It would have been obvious to one of ordinary skill in the art at the 
time the invention was made to use a micro-lens layer with the imaging system of 
Hashimoto in view of Roberts to increase photosensitivity. 

Conclusion 

8. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of 
time policy as set forth in 37 CFR 1 .1 36(a). 

A shortened statutory period for reply to this final action is set to expire 
THREE MONTHS from the mailing date of this action. In the event a first reply is 
filed within TWO MONTHS of the mailing date of this final action and the advisory 
action is not mailed until after the end of the THREE-MONTH shortened statutory 
period, then the shortened statutory period will expire on the date the advisory 
action is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be 
calculated from the mailing date of the advisory action. In no event, however, will 
the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

9. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Timothy J. Henn whose telephone number is 
(571 )272-731 0. The examiner can normally be reached on M-F 1 1 -7. 
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If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Sinh Tran can be reached on (571) 272-7564. The fax 
phone number for the organization where this application or proceeding is 
assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). If you would like assistance from a USPTO Customer Service 
Representative or access to the automated information system, call 800-786- 
9199 (IN USA OR CANADA) or 571-272-1000. 

/Timothy J Henn/ 

Examiner, Temporary Full Signatory Authority, Art Unit 2622 



